High-Performance Motion Correction of Fetal MRI

Fetal Magnetic Resonance Imaging (MRI) shows promising results for pre-natal diagnostics. The detection of potentially lifethreatening abnormalities in the fetus can be difficult with ultrasound alone. MRI is one of the few safe alternative imaging modalities in pregnancy. However, to date it has been limited by unpredictable fetal and maternal motion during acquisition. Motion between the acquisitions of individual slices of a 3D volume results in spatial inconsistencies that can be resolved by slice-to-volume reconstruction (SVR) methods to provide high quality 3D image data. Existing algorithms to solve this problem have evolved from very slow implementations targeting a single organ to general high-performance solutions to reconstruct the whole uterus. In this paper we give a brief overview over the current state-of-the art in fetal motion compensation methods and show currently emerging clinical applications of these technique

Towards segmentation and spatial alignment of the human embryonic brain using deep learning for atlas-based registration

We propose an unsupervised deep learning method for atlas based registration to achieve segmentation and spatial alignment of the embryonic brain in a single framework. Our approach consists of two sequential networks with a specifically designed loss function to address the challenges in 3D first trimester ultrasound. The first part learns the affine transformation and the second part learns the voxelwise nonrigid deformation between the target image and the atlas. We trained this network end-to-end and validated it against a ground truth on synthetic datasets designed to resemble the challenges present in 3D first trimester ultrasound. The method was tested on a dataset of human embryonic ultrasound volumes acquired at 9 weeks gestational age, which showed alignment of the brain in some cases and gave insight in open challenges for the proposed method. We conclude that our method is a promising approach towards fully automated spatial alignment and segmentation of embryonic brains in 3D ultrasound

Registration of 3D Fetal Brain US and MRI

We propose a novel method for registration of 3D fetal brain ultrasound and a reconstructed magnetic resonance fetal brain volumes. The reconstructed MR volume is first segmented using a probabilistic atlas and an ultrasound-like image volume is simulated from the segmentation of the MR image. This ultrasound-like image volume is then affinely aligned with real ultrasound volumes of 27 fetal brains using a robust block-matching approach which can deal with intensity artefacts and missing features in ultrasound images. We show that this approach results in good overlap of four small structures. The average of the co-aligned US images shows good correlation with anatomy of the fetal brain as seen in the MR reconstruction

Diffusion tensor driven image registration: a deep learning approach

Tracking microsctructural changes in the developing brain relies on accurate inter-subject image registration. However, most methods rely on either structural or diffusion data to learn the spatial correspondences between two or more images, without taking into account the complementary information provided by using both. Here we propose a deep learning registration framework which combines the structural information provided by T2-weighted (T2w) images with the rich microstructural information offered by diffusion tensor imaging (DTI) scans. We perform a leave-one-out cross-validation study where we compare the performance of our multi-modality registration model with a baseline model trained on structural data only, in terms of Dice scores and differences in fractional anisotropy (FA) maps. Our results show that in terms of average Dice scores our model performs better in subcortical regions when compared to using structural data only. Moreover, average sum-of-squared differences between warped and fixed FA maps show that our proposed model performs better at aligning the diffusion data

Motion corrected 3D reconstruction of the fetal thorax from prenatal MRI

In this paper we present a semi-automatic method for analysis of the fetal thorax in genuine three-dimensional volumes. After one initial click we localize the spine and accurately determine the volume of the fetal lung from high resolution volumetric images reconstructed from motion corrupted prenatal Magnetic Resonance Imaging (MRI). We compare the current state-of-the-art method of segmenting the lung in a slice-by-slice manner with the most recent multi-scan reconstruction methods. We use fast rotation invariant spherical harmonics image descriptors with Classification Forest ensemble learning methods to extract the spinal cord and show an efficient way to generate a segmentation prior for the fetal lung from this information for two different MRI field strengths. The spinal cord can be segmented with a DICE coefficient of 0.89 and the automatic lung segmentation has been evaluated with a DICE coefficient of 0.87. We evaluate our method on 29 fetuses with a gestational age (GA) between 20 and 38 weeks and show that our computed segmentations and the manual ground truth correlate well with the recorded values in literature

Efficient multi-class fetal brain segmentation in high resolution MRI reconstructions with noisy labels

Segmentation of the developing fetal brain is an important step in quantitative analyses. However, manual segmentation is a very time-consuming task which is prone to error and must be completed by highly specialized indi-viduals. Super-resolution reconstruction of fetal MRI has become standard for processing such data as it improves image quality and resolution. However, dif-ferent pipelines result in slightly different outputs, further complicating the gen-eralization of segmentation methods aiming to segment super-resolution data. Therefore, we propose using transfer learning with noisy multi-class labels to automatically segment high resolution fetal brain MRIs using a single set of seg-mentations created with one reconstruction method and tested for generalizability across other reconstruction methods. Our results show that the network can auto-matically segment fetal brain reconstructions into 7 different tissue types, regard-less of reconstruction method used. Transfer learning offers some advantages when compared to training without pre-initialized weights, but the network trained on clean labels had more accurate segmentations overall. No additional manual segmentations were required. Therefore, the proposed network has the potential to eliminate the need for manual segmentations needed in quantitative analyses of the fetal brain independent of reconstruction method used, offering an unbiased way to quantify normal and pathological neurodevelopment.Comment: Accepted for publication at PIPPI MICCAI 202

Anatomy-Aware Self-supervised Fetal MRI Synthesis from Unpaired Ultrasound Images

Fetal brain magnetic resonance imaging (MRI) offers exquisite images of the developing brain but is not suitable for anomaly screening. For this ultrasound (US) is employed. While expert sonographers are adept at reading US images, MR images are much easier for non-experts to interpret. Hence in this paper we seek to produce images with MRI-like appearance directly from clinical US images. Our own clinical motivation is to seek a way to communicate US findings to patients or clinical professionals unfamiliar with US, but in medical image analysis such a capability is potentially useful, for instance, for US-MRI registration or fusion. Our model is self-supervised and end-to-end trainable. Specifically, based on an assumption that the US and MRI data share a similar anatomical latent space, we first utilise an extractor to determine shared latent features, which are then used for data synthesis. Since paired data was unavailable for our study (and rare in practice), we propose to enforce the distributions to be similar instead of employing pixel-wise constraints, by adversarial learning in both the image domain and latent space. Furthermore, we propose an adversarial structural constraint to regularise the anatomical structures between the two modalities during the synthesis. A cross-modal attention scheme is proposed to leverage non-local spatial correlations. The feasibility of the approach to produce realistic looking MR images is demonstrated quantitatively and with a qualitative evaluation compared to real fetal MR images.Comment: MICCAI-MLMI 201

Familial risk of autism alters subcortical and cerebellar brain anatomy in infants and predicts the emergence of repetitive behaviors in early childhood

Autism spectrum disorder (ASD) is a common neurodevelopmental condition, and infant siblings of children with ASD are at a higher risk of developing autistic traits or an ASD diagnosis, when compared to those with typically developing siblings. Reports of differences in brain anatomy and function in high‐risk infants which predict later autistic behaviors are emerging, but although cerebellar and subcortical brain regions have been frequently implicated in ASD, no high‐risk study has examined these regions. Therefore, in this study, we compared regional MRI volumes across the whole brain in 4–6‐month‐old infants with (high‐risk, n = 24) and without (low‐risk, n = 26) a sibling with ASD. Within the high‐risk group, we also examined whether any regional differences observed were associated with autistic behaviors at 36 months. We found that high‐risk infants had significantly larger cerebellar and subcortical volumes at 4–6‐months of age, relative to low‐risk infants; and that larger volumes in high‐risk infants were linked to more repetitive behaviors at 36 months. Our preliminary observations require replication in longitudinal studies of larger samples. If correct, they suggest that the early subcortex and cerebellum volumes may be predictive biomarkers for childhood repetitive behaviors

Familial risk of autism alters subcortical and cerebellar brain anatomy in infants and predicts the emergence of repetitive behaviors in early childhood.

Autism spectrum disorder (ASD) is a common neurodevelopmental condition, and infant siblings of children with ASD are at a higher risk of developing autistic traits or an ASD diagnosis, when compared to those with typically developing siblings. Reports of differences in brain anatomy and function in high-risk infants which predict later autistic behaviors are emerging, but although cerebellar and subcortical brain regions have been frequently implicated in ASD, no high-risk study has examined these regions. Therefore, in this study, we compared regional MRI volumes across the whole brain in 4-6-month-old infants with (high-risk, n = 24) and without (low-risk, n = 26) a sibling with ASD. Within the high-risk group, we also examined whether any regional differences observed were associated with autistic behaviors at 36 months. We found that high-risk infants had significantly larger cerebellar and subcortical volumes at 4-6-months of age, relative to low-risk infants; and that larger volumes in high-risk infants were linked to more repetitive behaviors at 36 months. Our preliminary observations require replication in longitudinal studies of larger samples. If correct, they suggest that the early subcortex and cerebellum volumes may be predictive biomarkers for childhood repetitive behaviors. Autism Res 2019, 12: 614-627. © 2019 The Authors. Autism Research published by International Society for Autism Research published byWiley Periodicals, Inc. LAY SUMMARY: Individuals with a family history of autism spectrum disorder (ASD) are at risk of ASD and related developmental difficulties. This study revealed that 4-6-month-old infants at high-risk of ASD have larger cerebellum and subcortical volumes than low-risk infants, and that larger volumes in high-risk infants are associated with more repetitive behaviors in childhood